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MULTICOLOR STARING SENSOR SYSTEM 

This invention relates to a sensor system, and, more particularly, to a 
sensor system used to detect threats posed by missiles fired at an aircraft. 

RACK GROUND OF THE INVENTION 

5 Missiles fired at aircraft are usually guided either by a light seeker or by 

radar. Of the various types of seekers, infrared light seekers pose some of the 
greatest problems to aircraft defense. Unlike radar seekers, infrared seekers are 
passive and do not emit a detectable signal prior to the firing of the missile. Pilots 
therefore have little warning of their presence prior to the firing of the missile. 

10 Infrared-guided missile systems are relatively inexpensive, and human-portable 
units are widely available. 

There has been a continuing effort to develop sensor systems that are 
carried on aircraft and are used to detect missile threats, particularly infrared- 
guided missiles. The sensor system must be effective to detect the infrared 

1 5 signature of a relatively small-sized missile at as great a distance as possible, in 
order to give the pilot the greatest time to take evasive action or to trigger 
counter-measures. In one approach, a wide-angle, two-color staring sensor system 
has been suggested to be particularly effective in detecting threats. This approach 
uses a two-color "sandwich" detector in the sensor. The technology of such a 

20 two-color detector is complex, still under development, and expected to be 
relatively expensive when finally perfected. Additionally, it is expected to have 
limited resolution, sensitivity, and clutter-rejection capability, particularly when 
mounted on a fast-moving aircraft platform where there is a tendency for digital 
images to be smeared in some viewing orientations. 

25 There is an ongoing need for an improved approach to a sensor system for 

use in an aircraft, particularly for detection of missile threats. The present 
invention fulfills this need, and further provides related advantages. 
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STTMMARY OF THE INVENTION 



The present invention provides a sensor system for sensing the energy of 
a scene, particularly in the infrared range. The sensor system employs a staring 
sensor, so that there are no moving parts that might reduce its reliability. It may 
5 be made in a single-color or multicolor functionality. The sensor system achieves 
excellent resolution while maximizing sensitivity through a short image 
integration time that also reduces smearing of the image. The detector is a single- 
color detector structure, whether the sensor has a single-color or multicolor 
functionality, so that the development, complexity, and cost associated with a two- 
10 color detector are not encountered. The sensor system is packaged in a 
lightweight, small package that is convenient for many applications. 

A sensor system for viewing light energy from a scene comprises a 
detector which converts incident light energy into an electrical signal; an optical 
train that focuses the light energy from the scene; and an optical fiber bundle 
15 having an input end that receives the light energy from the optical train and an 
output end that directs the light energy onto the detector. The detector is 
preferably an imaging detector having a detector pixel array. The optical fiber 
bundle comprises a plurality of optical fibers wherein each fiber has an input 
shape and size at its input end and an output shape and size at its output end, and 
20 where the output shape and size are different from the input shape and size. 

In a preferred approach, the light energy from the optical train is mapped 
nonlinearly onto the detector. Desirably, the input shape of each fiber is 
substantially in the form of a rectangle, and the output shape is substantially in the 
form of a square. The fiber input size of each respective optical fiber is preferably 
25 larger than the fiber output size of each respective optical fiber. The sensor 
system also typically includes an electronic device operable to read the electrical 
signal of the detector, and image-processing electronics. Optionally, there is a 
color filter positioned between the scene and the detector. The detector may be 
single-color or multicolor functionality. 
30 The sensor system may use a multiple side-by-side detector configuration, 

each of which detectors is a single-color detector and is thus easier to fabricate 
than a multi-color detector. Such a sensor system comprises a detector, preferably 
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having an imaging detector array, which converts incident light energy into an 
electrical signal. The detector has a first-color region and a second-color region. 
A first-color imaging system comprises a first-color filter positioned between the 
scene and the first color region of the detector, a first-color optical train that 
focuses first-color scene energy onto the first-color region of the detector, and a 
first-color optical fiber bundle having a first-color input end that receives the first- 
color scene energy from the first-color optical train and a first-color output end 
that directs the first-color scene energy onto the first-color region of the detector. 
The first-color optical fiber bundle comprises a plurality of first-color optical 
fibers wherein each of the first-color optical fibers has a first-color fiber input 
shape and size at its first-color input end and a first-color output shape and size 
at its first-color output end. The first-color output shape and size are different 
from the first-color input shape and size. A second-color imaging system 
comprises a second-color filter positioned between the scene and the second-color 
1 5 region of the detector, a second-color optical train that focuses second-color scene 
energy onto the second-color region of the detector, and a second-color optical 
fiber bundle having a second-color input end that receives the second-color scene 
energy from the second-color optical train and a second-color output end that 
directs the second-color scene energy onto the second-color region of the detector. 
20 The second-color optical fiber bundle comprises a plurality of second-color 
optical fibers wherein each of the second-color optical fibers has a second-color 
fiber input shape and size at its second-color input end and a second-color output 
shape and size at its second-color output end. The second-color output shape and 
size are different from the second-color input shape and size. The additional 
25 and/or preferred features described above for the single-color sensor system may 
be provided with either or both imaging systems of the two-color sensor system. 
Additional color imaging systems may be added if desired. The detector may 
instead be a flat-plane configuration in which the colors are superimposed in a 
"sandwich" geometry. 
30 The present approach thus provides a single-color or multicolor (two or 

more colors) staring sensor system. It may use a single detector, even for 
multicolor sensors, which simplifies the problems of image physical registration 
and time registration. There is good resolution as well as good sensitivity and 



short integration times. 

Other features and advantages of the present invention will be apparent 
from the following more detailed description of the preferred embodiment, taken 
in conjunction with the accompanying drawings, which illustrate, by way of 
example, the principles of the invention. The scope of the invention is not, 
however, limited to this preferred embodiment. 

RRTFF DESCRIPTION OF THE DR AWINGS 

Figure 1 is a schematic system diagram of the sensor system; 
Figure 2 is perspective view of an optical fiber in an optical fiber bundle; 
Figure 3 is a schematic depiction of nonlinear mapping of the fiber optic 
pixel structure to the detector array pixel structure; and 

Figure 4 is a perspective view of a packaged lens and detector assembly. 

nF.TAn.RD DESCRIPTION OF THE INVENTION 

Figure 1 depicts a sensor system 20 for viewing light energy from a scene. 
The sensor system 20 includes a detector 22 which converts incident light energy 
into an electrical signal 23. The detector 22 preferably comprises an imaging 
digital focal plane array (FPA) sensitive to a selected wavelength or range of 
wavelengths of interest. The primary interest of the inventors is light in the 
infrared, and the detector 22 is sensitive to light in that range. Imaging detectors 
22 operable in the infrared are known in the art. In a common case, the imaging 
detector 22 has a 5 12 x 5 12 detector array of pixels. 

In a preferred embodiment, the detector 22 has a first-color region 24 and 
a second-color region 26. As will be explained in more detail, this preferred 
embodiment is a two-color sensor system 20. The desirability of using two colors 
in sensor systems is known in the art, but the present approach provides an 
advantageous way for implementing the two-color approach. The present 
approach is operable with any pair of colors within the range of the detector 22, 
and the selection of the two specific colors to be analyzed is not a part of the 
present invention. If instead the sensor system 20 is a single-color embodiment, 



the entire detector is devoted to that single color; if the sensor system 20 operates 
with more than two colors, the detector 22 has regions corresponding to the 
number of colors. In most instances, it is not necessary or desirable for the sensor 
system 20 to operate with more than two colors. 

The sensor system 20 includes a first-color imaging system 28 comprising 
a first-color filter 30 positioned between the scene and the first-color region 24 of 
the detector 22. A first-color optical train 32 focuses first-color scene energy onto 
a first-color input end 38 of a first-color optical fiber bundle 36 of the first-color 
region 24 of the detector 22. The first-color optical train 32 is formed of lenses 
and/or mirrors that achieve the desired focusing of the first-color scene energy. 
Such lenses and/or mirrors are selected according to established optics principles. 
In the illustration, the first-color filter 30 is positioned between the first-color 
optical train 32 and the first-color optical fiber bundle 36, but that need not be the 
case and other operable positioning may be used. 

The first-color optical fiber bundle 36 has the first-color input end 38 that 
receives the first-color scene energy from the first-color optical train 32, and a 
first-color output end 40 that directs the first-color scene energy onto the first- 
color region 24 of the detector 22. The first-color optical fiber bundle 36 is 
formed of a plurality of first-color optical fibers 42. 

One of the first-color optical fibers 42 is illustrated in Figure 2. (This 
description is applicable to the single type of optical fiber in a single-color sensor 
system and the multiple types of optical fibers in a multi-color sensor system, as 
well.) Each of the first-color optical fibers 42 has a first-color fiber input shape 
and size, numeral 44, at its first-color input end 38a and a first-color fiber output 
shape and size, numeral 46, at its first-color output end 40a. The first-color fiber 
output shape and size 46 are different from the first-color fiber input shape and 
size 44. In the embodiment of Figure 2, the first-color fiber input shape 46 is 
substantially rectangular with a ratio of length to width of about 8:1, and the first- 
color fiber output shape 46 is substantially square with a ratio of the sides of about 
1:1. The first-color input size is accordingly about 8 times that of the first-color 
output size. The first-color optical fibers 42 are thus tapered from the larger input 
end 38a to the smaller output end 40a. The advantages of this transformation of 
pixel shape as used with a spatial reorientation, such that a typical square pixel 



detector can be used, as will be explained subsequently. 

The rectangular shaping of the first-color optical fibers 42 achieves 
improved resolution in one dimension to maximize the sensitivity of the sensor 
system 20. Because the potential target (e.g., a missile) in the scene and the 
resulting image has a small spatial extent, clutter rejection is achieved by spatially 
filtering objects in the image that are larger than the potential target. Ideally, then, 
the resolution cell is no larger than the maximum potential angular size of the 
potential target. However, small square fiber input shapes, the usual approach in 
pixilated images, would require a larger focal plane array detector than is 
achievable at present for a wide field-of-view system. In addition, this resolution 
would be better than the hand-off accuracy that is required. By creating larger 
rectangular collection elements at the input end, the required high spatial 
resolution is achieved with fewer pixel elements than would otherwise be 
required. The angular accuracy of the sensor system 20 is determined by the long 
dimension of the input end 38a of the optical fibers, while the resolution for target 
spatial matched filtering is determined by the narrow dimension. In an example, 
assuming a 512 x 512 pixel focal plane array and a 120 degree field of view, the 
accuracy is 1 1.6 mradians (milliradians) and the resolution is 1.45 mradians. 

The tapered fibers also increase the energy collection area significantly 
over the area of a conventional focal plane array detector. In the example of 
Figure 2, with an 8 x 1 input end and a 1 x 1 output end, the increased area of a 
factor of 8 in the entrance aperture enables a corresponding decrease in integration 
time. The sensor system 20 is therefore more resistant to blurring of the image 
than a conventional sensor system. 

The pixels that are defined by the first-color input end 38a of the first-color 
optical fibers 42 are mapped or directed onto selected pixels of the first-color 
region 24 of the detector 22. In conventional mapping practice, the pixels are 
mapped linearly. That is the (n,m) pixel of the scene is necessarily directed to the 
(n,m) pixel of the detector (where n and m are the row and column indices of each 
pixel). The present approach is a nonlinear approach wherein the (n,m) pixel of 
the scene is not necessarily directed to the (n,m) pixel of the detector. 

Figure 3 illustrates the preferred mapping approach applied to a specific 
case by way of illustration. This nonlinear mapping approach is selected to allow 
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a standard detector array to be used with rectangular input pixels. In this 
illustration, a 128 x 1024 array of first-color scene energy at the first-color input 
end 38 is mapped onto one-half of a 512 x 512 detector array (the other half 
receives the second-color image). The (X L ,Y L ) pixel of the first-color scene 
energy is mapped to the (X F ,Y F ) pixel of the first-color region 24 of the detector 
22. The first-color image uses all rows of the detector 22 and columns 1-256 in 
this example. The following regions describe the preferred mapping approach: 

X F = X L -(256)(Y F -1) 
Y F = 4(Y L -l) + n 

where 

n - 1 for X L < 256 
n = 2 for 257 s X L ^ 512 
n = 3 for 513 < X L < 768 
n = 4 for 769 ^ X L ^ 1024 

The sensor system 20 further includes a second-color imaging system 48 
comprising a second-color filter 50 positioned between the scene and the second- 
color region 26 of the detector 22. A second-color optical train 52 focuses 
second-color scene energy onto a front face 58 of the second-color fiber optic 
bundle 56 of the second-color region 26 of the detector 22. The second-color 
optical train 52 is formed of lenses and/or mirrors that achieve the desired 
focusing of the second-color scene energy. Such lenses and/or mirrors are 
selected according to established optics principles, and are preferably substantially 
identical to the lenses and/or mirrors of the first-color optical train 32. In the 
illustration, the second-color filter 50 is positioned between the second-color 
optical train 52 and the second-color fiber optic bundle 56, but that need not be 
the case and other operable positioning may be used. 

The second-color optical fiber bundle 56 has the second-color input end 
58 that receives the second-color scene energy from the second-color optical train 
52, and a second-color output end 60 that directs the second-color scene energy 
onto the second-color region 26 of the detector 22. The second-color optical fiber 
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bundle 56 is formed of a plurality of second-color optical fibers 62. 

The second-color optical fibers 62 are preferably tapered in the same 
manner as described for the first-color optical fibers 42. Figure 2 and the 
discussion of Figure 2 are incorporated as to the nature of the second-color optical 
5 fibers 62. 

The second-color scene energy on the second-color optical train 52 is 
mapped nonlinearly onto the second-color region 26 of the detector 22 in the same 
manner as discussed earlier for the first-color scene energy. The prior description 
is incorporated by reference here. 

10 The mapping of the second-color scene energy pixels onto the second- 

color region 26 of the detector 22 follows the approach discussed above, which 
is incorporated here, except that X F is offset by 256 to utilize columns 257 through 
512 of the detector 22. 

The detector 22 converts the incident light energy to electrical signals, 

15 which are processed by its associated electronics 70 to compensate for detector 
irregularities, perform calibration, and perform related functions. The processed 
electrical signals are provided to a computer system that analyzes the electrical 
signals for the presence of a feature, specifically a missile threat. The presence of 
a feature is first determined, numeral 72, by appropriate digital filtering. Any 

20 such feature is then analyzed as to its nature, numeral 74, using established 
criteria. This information is then used to control the detector 22, numeral 76. The 
data on a feature judged to be a threat is provided to other processing electronics, 
not shown, such as a fire control system. Approaches to these elements 70, 72, 74, 
and 76 are known in the art. 

25 Figure 4 illustrates the physical packaging of the non-electronic portions 

of the lens/detector assembly 80 (that is, excluding elements 70, 72, 74, and 76) 
of the sensor system 20, in an application under development by the inventors. 
The lens/detector assembly is housed in a cylinder about 4-1/4 inches in diameter 
and 4-3/4 inches long. There are two viewing apertures 82 and 84, for the first- 

30 color imaging system 28 and the second color imaging system 48, respectively. 

Although a particular embodiment of the invention has been described in 
detail for purposes of illustration, various modifications and enhancements may 
be made without departing from the spirit and scope of the invention. 
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Accordingly, the invention is not to be limited except as by the appended claims. 
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